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Abstract. We present a general method for obtaining the spectra of large 
graphs with short cycles using ideas from statistical mechanics of disordered 
systems. This approach leads to an algorithm that determines the spectra of 
graphs up to a high accuracy. In particular, for (un)directed regular graphs 
with cycles of arbitrary length we derive exact and simple equations for the 
resolvent of the associated adjacency matrix. Solving these equations we obtain 
analytical formulas for the spectra and the boundaries of their support. 



1. Introduction 

In spectral graph theory one uses spectral analysis to study the interplay be- 
tween the topology of a graph and the dynamical processes modelled through the 
graph [TJ O [3l [4] . In fact, various dynamical processes in disciplines ranging from 
physics, biology, information theory, and chemistry to technological and social sci- 
ences are modelled with graph theory. Therefore, graph theory forms a unified 
framework for their study [51 [6] . In particular, one associates a certain matrix to 
a graph (e.g. the adjacency matrix, the Laplacian, the google matrix) and studies 
the connection between the spectral properties of this matrix and the properties of 
the dynamical processes governed through them. We mention some studies in this 
context: the stability of synchronization processes [7J [8], the robustness and the 
effective resistance of networks [Sj, error-correcting codes (10] , etc. 

These examples illustrate how spectral graph theory relies to a large extent 
on the capability of determining spectra of sparse graphs. It is thus important to 
develop mathematical methods which allow to derive in a systematic way exact 
analytical as well as numerical results on spectra of large graphs. For an overview 
of analytical results on the spectra of infinite graphs we refer to the paper of Mohar 
and Woess [4] . 

Recently, the development of exact results for large sparse graphs has been 
reconsidered using ideas from statistical physics of disordered systems. In this 
approach one formulates the spectral analysis of graphs in a statistical-mechanics 
language using a complex valued measure The spectrum is given as the free 
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energy density of this measure, which can be calculated using methods from disor- 
dered systems such as the replica method [12] , the cavity method I13L 114] or the 
super-symmetric method |15) . This approach is exact for infinitely large graphs 
that do not contain cycles of finite length. In recent works the cavity method has 
been generalized to the study of spectra of graphs with a community structure |16j 
and spectra of small- world graphs |17) . The replica and cavity methods have also 
been used to derive the largest eigenvalue of sparse random matrix ensembles [18] . 
Although the cavity method is heuristic, it has been considered in a rigorous setting 
for undirected sparse graphs using the theory of local weak convergence |19j . How- 
ever, for directed sparse graphs the asymptotic convergence of the spectrum to the 
resultant cavity expressions has not been shown [20] . Nevertheless, recent studies 
have shown the asymptotic convergence of the spectrum of highly connected sparse 
matrices to the circular law |21) 122) 123), 124] and have proven the asymptotic con- 
vergence of the spectrum of Markov generators on higly connected random graphs 
[25] . These studies, however, do not concern finitely connected graphs. 

In this work we extend the statistical-mechanics formulation, in particular the 
cavity method for the spectra of large sparse graphs which are locally tree-like 
|13L 114), 119] . to large sparse graphs with many short cycles. Such an extension is 
relevant because cycles do appear in many real-world systems such as the internet 
[26L 1271 128] , We derive a set of resolvent equations for graph ensembles that 
contain many cycles of finite length. These equations are exact for infinitely large 
(un)directed Husimi graphs [29 , 30 and solving them constitutes an algorithm for 
determining the spectral density of these graphs. 

First, we show how this algorithm determines the spectra of irregular Husimi 
graphs up to a high accuracy, well corroborated by numerical simulations. Then we 
derive novel analytical results not only for the spectra of undirected regular Husimi 
graphs, but also for the spectra of directed regular Husimi graphs. In particular, 
we show that the boundary of the spectrum of directed Husimi graphs composed 
of cycles of length £, is determined by a hypotrochoid with radii R/r = £ (R being 
the radius of the fixed circle and r of the moving circle). Not many analytical 
expressions for the spectra of directed sparse random graphs and non-Hermitian 
random matrices are known (besides some exceptions, see [31] ). A short account 
of some of our results on regular graphs has appeared in [32] . 

2. Ensembles of graphs 

Networks appearing in nature are usually modelled with theoretical ensembles 
of graphs. These ensembles consist of randomly constructed graphs with certain 
topological constraints on their connectivity. Model systems allow for a better 
understanding of the properties of the more complex real- world systems [H [6] . 

In this work we consider simple graphs Q = (V,E) of size N = \V\ consisting 
of a discrete set of vertices V and a set of edges E C V x V. Simple graphs are 
uniquely defined by their adjacency matrix A, with elements ■ = Ay £ {0, 1} 
for i,j £ V and [A] u = for V i. We have Ay = 1 when £ E and zero 

otherwise. An undirected edge is present between i and j when Ay — Aji = 1, a 
directed edge is present from i to j when Ay = 1 and Aji = 0, while Ay = Aji = 
indicates that there is no edge present between i and j. 

We define graph ensembles through a normalized distribution P(A) for the 
adjacency matrices A. Selecting a graph from the ensemble corresponds with 
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drawing randomly an adjacency matrix from the distribution P{A). We always 
consider ensembles of infinite graphs, for which N — > oo. This is implicitly as- 
sumed throughout the whole paper. Below, we first define random graphs which 
are locally tree-like. Their spectral properties have been considered in several stud- 
ies [H 1131 1141 1191 1331 134] . Second, we define ensembles of graphs with many 
cycles: the cacti or Husimi graphs |29L 130) . 




Bethe lattice Husimi lattice Square lattice 



Figure 1. Three different regular graphs rooted around the cen- 
tral vertex. The central vertex is denoted by a square while its 
neighbours are denoted by triangles. The dashed lines indicate the 
edges between the leaves of the rooted graph. Left: a 4- regular 
graph. The rooted graph is locally tree-like. Center: a (4, 2)- 
regular Husimi graph. The rooted graph is not tree-like but does 
maintain an infinite-dimensional nature. Right: a non-random 
graph (the square lattice). 



2.1. Graphs with a local tree structure. Ensembles of random graphs 
with only certain constraints on the vertex degrees are locally tree-like. Some well- 
studied examples with these characteristics are the ensemble of c-regular graphs 
(also called Bethe lattices) and the ensemble of irregular Erdos-Renyi graphs [35] . 
For undirected graphs, these ensembles can be formally defined as follows: 

• c-regular graphs with fixed connectivity c: 

N 

(2.1) P Icg (A- c) ~ J] 6(a;c) J] 6(Aij]Aji), 

i—l i<j 

with a = Aji the degree of the i-th vertex. Figured] presents a sketch 
of a Bethe lattice. 

• Erdos-Renyi graphs with mean connectivity c: 

(2.2) P ilIcg (A; c) ~ J] (±5 (A if , 1) + (l - 6 (A ij; 0)) [] S (A^A^) . 

i<j i<j 

In this ensemble the degrees fluctuate from vertex to vertex within the 
graph. The distribution of vertex degrees converges to a Poissonian dis- 
tribution with mean c in its asymptotic limit N — > oo. 
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Ensembles of directed graphs can be defined similarly by leaving out the symme- 
try constraints in the definitions eqs (|2.f I) and (|2.2[) and by taking into consideration 
the difference between Aij and A^. For instance, we define a c- regular ensemble of 
directed graphs by the constraint c° ut = c" 1 = c for any i, with the indegree defined 
as c™ = J2j Aji and the outdegree as c° ut = J2j A ij • 

The Erdos-Renyi and the c-regular ensemble have the local tree property, 
i.e. the probability to encounter a cycle of finite length in the local neighbour- 
hood of a vertex becomes arbitrary small for N — > oo |35j . The local tree property 
of random graphs is an important characteristic which has allowed to determine the 
spectra of sparse graphs in previous works [13j 1141 119] . This property is illustrated 
in figure Q] for the Bethe lattice: cycles only appear at the leaves of the tree, where 
the vertex constraints have to be satisfied such that their typical length is of the 
order log(iV). 

2.2. Ensembles with cycles. Next, we define graph ensembles which con- 
tain many short cycles and are, therefore, not locally tree-like. A cycle of length 
£ is defined by a set of nodes (£i,i2) • " ' with an edge connecting each pair 
(i n , *(n+i)(mod a), for fi = The set of all ^-tuples is denoted by V 1 . We de- 

fine the following ensembles which are very similar to the Husimi graphs in |29l I30j : 

• (£, c)-regular Husimi graphs with fixed connectivity c and fixed cycle 
length £: 

N 

(2.3) Pre S (A;c,l) ~ lldic-ollMA.-A,,:. 

i—1 i<j 

where q denotes now the number of i'-cycles of A incident to the i-th ver- 
tex. In figure [5] we show the typical local neighbourhood of an undirected 
(4,2)-regular Husimi graph. 

• irregular Husimi graphs with fixed cycle length £ and mean loop connec- 
tivity c: 



(2.4)P irreg (A;c^)~ [] 



e-i 



k=l 



1 - J^=l) $ ( A ^u 11 A ^ k+1 ;0 ) x IJ.V.l,,:.!,,) 



k=l 



n s a v n i n A ^ n+1 ) A ke _ 2 f,A t 




The set C V e consists of all ^-tuples 7 k e _ 2 ,j) & V 1 . The 

first factor gives a weight c/N 1 ^ 1 to each randomly drawn cycle of length 
£, the second factor is the constraint which makes the graph undirected 
and the last factor is a constraint which takes into consideration that each 
edge must belong to exactly one cycle of length £. 

We remark that in our notation of Husimi graphs the mean cycle connectivity c 
is the average number of cycles of length £ connected to a certain vertex, while 
2c denotes the mean degree of each vertex. Note that for £ — 2 the ensembles of 
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Husimi graphs introduced here reduce to the corresponding ensembles of random 
graphs which are locally tree- like (discussed in the previous subsection). 

As before, we can define as well directed ensembles of Husimi graphs by remov- 
ing the symmetry constraint Yii<j &{A*i ; A-ji) and taking into consideration the 
possible difference bewcen Aij and Aji. For instance, for a regular Husimi graph 
we set the mean vertex indegree and the mean vertex outdegree equal to 2c. In 
figure[2]we present the neighbourhood of a vertex in a directed (3,2)-regular Husimi 
graph. 

Husimi graphs are not locally tree-like since they are composed of cycles, but 
they do have an infinite-dimensional character. Indeed, the local neighbourhood 
of a vertex contains different branches which are only connected by cycles of order 
\og(N), see figures [T] and [2j This property allows us to present an exact spectral 
analysis. 




Figure 2. [32j Local structure of some (£, c)-regular Husimi 
graphs, with £ the cycle length and c the cycle connectivity. Left: 
directed (3, 2)-regular Husimi graph. Right: undirected (4, 2)- 
regular Husimi graph. The Husimi graphs are infinite dimensional 
as different branches of a central node are separated by a distance 
of the order O(lniV). 



3. Spectral analysis of undirected graphs with cycles 

In this section we show how to determine the spectral properties of undirected 
graphs with cycles. For regular graphs, our approach, briefly presented in [32] , 
consists of four steps. First, we write the spectrum in statistical mechanics terms 
using a complex measure. Then we use the infinite-dimensional nature of the graphs 
to derive a closed expression in the submatrices of the resolvent. Next, we simplify 
the resolvent equations to the specific case of regular undirected Husimi graphs. 
Finally, we solve the resultant algebraic expressions to find analytical expressions 
for the spectra of regular Husimi graphs. 

3.1. Statistical mechanics formulation of the spectrum. We define the 
resolvent of a real symmetric matrix A as 

(3.1) G{z) = {A-zI N y 1 , 

where In is the N x N identity matrix and z € C, with Re(z) = A and Im(z) > 
0. From the resolvent we can determine the asymptotic density p(X) of the real 
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eigenvalues A of an ensemble of matrices A [4] : 



(3.2) 



p(X) = lim lim Im 

lm(z)^0+ JV^oo 



TrG 



irN 



We have left out ensemble averages since we assume that the spectrum self-averages 
in the limit N — > oo to a deterministic value. 

A common method in statistical physics is to write the resolvent elements and 
the spectrum as averages over a certain complex- valued measure P(x;z)dx [llj . 
Indeed, when defining the normalized Gaussian function 



(3.3) 



P{x; z) ~ exp ( ^x T G 1 (z)x 



the diagonal elements [G\ u — Gi are given by 
(3.4) 



with (•) the average with respect to P(x;z). In this formalism the spectrum 
is written as 



(3.5) 
with 
(3.6) 

such that 
(3.7) 



p(A) = — lim lim Im 

Im(z)->0+ N^oo nN 



d_ 
dX 



InZ 



Z = 



dxexp ( -x T G 1 (z)x 



i N 

lim VlmGi(z), A = Re[zl 

Im[z]->0+ TrN — ' W L J 

i—1 



Hence, in the language of statistical mechanics the spectrum is the imaginary 
part of the derivative of the free energy density with respect to A, as is seen explicitly 
in eq. (|3.5|) . 



3.2. The resolvent equations. We employ the cavity method to determine 
the spectral properties of locally tree-like graphs |13l 119) . We construct a matrix 
(and its corresponding resolvent G^) through deletion of the i-th column and 
the i-th row in A. The graph induced by the matrix A^ is usually referred to 
as the cavity graph [37] . On this graph we use the Bethe-Peierls tree approximation 
[371 138) to arrive at the following set of resolvent equations: 

1 „ 1 



(3.8) 



G 



Gi 



V A 2 (7® ' 



;k£di\j 

where di is the set of vertices neighbouring i, and di \ j denotes the set of all 
neighbours of i except for node j. In appendix I A. 1 1 we report the essential steps in 
deriving these resolvent equations. 

The resolvent equations ()3.8|) have appeared in the literature for the first time, 
as far as we know, in the study of electron localization [39j ■ Similar equations have 
been derived in the context of Levy matrices |40j and in the more general context 
of sparse random graphs [13j . The resolvent equations (|3.8j) form a set of 2\E\ 
equations in 2 \E\- unknowns. 
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We interpret the set of equations for {G^} as a message-passing algorithm 
along the induced graph CJ, similar to belief propagation which is widely used in 
statistical inference and information theory [41] . Here the messages are the diagonal 
elements of the resolvent of the cavity graph |13] . 

Next, we extend the resolvent equations (|3.8I) to Husimi graphs with many 
short cycles. Although the Bethe-Peierls approximation is no longer valid on these 
graphs, they still contain an infinite-dimensional character allowing for an analo- 
gous approximation. In statistical mechanics this forms the basis for the Kikuchi 
approximation [42] 143) . For Husimi graphs the Kikuchi approximation gives us 
the resolvent equations: 

(3.9) G« = - — L a — L 



with a € df ^ and with of ^ the set of all (£ — l)-tuples (jt,j2, ■ ■ ■ ,je-i) which 
form a cycle of length I with the node i. The elements of the (I — l)-dimensional 
matrix L a are [L a ] nm = [L {jl>j2> ... , je _ 1 )] nm = S n ( m +i)A jnjm , with n,m = 1, {£- 

1). The quantity D$ is a diagonal matrix with elements 

Ped l / k ~ 1 \(i,ji,...,j k -i,j k + 1 ,...,jt-i) 

with a = (ji, j'2, • • • We have also defined the (I — l)-dimcnsional vector 

A J k ,P = A jk,(k u k 2 ,-,k e -i) = ( A jkk! ... Aj^^J. The diagonal elements of 
the resolvent are given by 

(3.10) Gi = 



1 



In appendix I A. 2 1 we elaborate on the precise derivation of these equations. 

The resolvent equations (|3.9|) determine the spectra of graphs with many short 
cycles of fixed length I. Note that they can be straightforwardly generalized to 
graphs with variable cycle lengths and, even more general, to graphs composed 
from arbitrary figures, by replacing L a by the corresponding adjacency matrix of 
the figure a in the absence of a node i, and Aj ki p by the submatrix of A connecting 
the figure and the node jk- In our case, the figures of the graph are the (I — 1)- 
tuples a. The set of resolvent equations (|3.9[) - (I3.10I) can also be seen as a message- 
passing algorithm between regions of the graph, which is similar to the generalized 
belief propagation algorithm in information theory |43j . Here the messages of the 
algorithm are the (1 — 1) x (£ — 1) matrices G^} sent from the (£ — l)-tuples a to 
a vertex i, with whom the tuple a forms a cycle of length £ in the graph. 

We have verified the exactness of the resolvent equations (|3.9|) - (|3.10l) on irreg- 
ular Husimi graphs with £ = 3 through a comparison with direct diagonalization 
results. This is presented in figure [3j where we also compare the spectrum of ir- 
regular Husimi graphs with mean cycle connectivity c = 3 with the spectrum of 
Erdos-Renyi random graphs with the same mean vertex degree c — 6. From these 
results it appears that the spectrum of Erdos-Renyi graphs converges faster to the 
Wigner semicircle for c — > oo. 

Finally, we point out that the ensemble definitions in section 2 are global by 
specifying P(A). In the derivation of the resolvent equations (|3.9|) - ()3.10|) these 
global definitions are not explicitely used. Instead, our analysis uses the typical 
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local neighbourhoods of the vertices in the graph. Therefore, our results are valid 
for all graphs which have a local neighbourhood similar to the one given by the re- 
solvent equations. The connection between the global definitions and the resolvent 
equations can be made explicit through the distribution of local vertex neighbour- 
hoods, see for instance [19] . This is how we have derived the results in figure [3] 



0.75 



1 




— c = 3, ell=3 






-- c = 6,ell=2 






■ ■ ■ Wigner 










— i 




i v?)i I*.. 





X 



Figure 3. The density of eigenvalues A for an irregular triangu- 
lar Husimi graph [l = 3) of mean connectivity c = 3 with scaling 
Aij — > Aij j\j2c— 1 (solid lines) is compared with the eigenvalue 



= 2) of mean connec- 
(dashed lines). Both 



density of an irregular Erdos-Renyi graph (I 
tivity c = 6 with scaling Ay — > Ay / \fc— 1 
ensembles have the same mean vertex degree. Results from solving 
the equations p.9H3.10[) for i = 3 with a regulator Im(z) = 10~ 4 
are compared with direct diagonalization results (markers). The 
dotted line is the Wigner semi-circle law. 



In the next two sections we solve the resolvent equations for the case of undi- 
rected regular Husimi graphs for which they simplify considerably. 



3.3. The resolvent equations for regular undirected graphs. In this 
section we consider graphs with a simple topology that allows to extract exact 
analytical solutions from the resolvent equations (|3.9j) - (|3.10j) : regular Husimi graphs 



(t-i) 



c and A 



1 for all 



with cycles. For this ensemble of random graphs 

connected pairs In figure[2]the square undirected Husimi graph is illustrated. 

Since there is no local disorder every node has the same local neighbourhood. 
For N — > oo the graph becomes transitive and we can set 



(3.11) 



G«(z) = C(z), G l (z) = G(z) 1 
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in the resolvent equations (|3.9[) . We get the following closed equations in the 
dimensional matrices C: 



/ z- (c- l)A T C{z)A 



(3.12) C(z) = 



-1 




-1 
(c - l)A T C{z)A -1 

-1 



V 



and the resolvent follows from 
(3.13) G(z) = 



■A T C(z)A, 



where.4 T = (l ... 1). It is convenient to introduce the scalar variable G s {z) 
A T C(z)A and rewrite ([332]) as 



/ z-(c-\)G s {z) 

-1 z - 



(3.14) G s (z) = A 1 



-1 
(c-l)G s (z) -1 



V 1 







V 



A. 



J 



The matrix in (|3.14[) has a simple structure. We have calculated the inverse analyt- 
ically using specific methods for tridiagonal matrices |44j . This leads to our final 
formula for G s when £ > 2 



(3.15) 



G„ = 



2nt_ 



ni-i 



The coefficients n 2 , . . . , ng_\ are complex numbers given by the recurrence relation 
(3.16) rii = nwi-i - n,_2, i > 2 

with initial values n = 1 and n\ = z — (c — l)G s . Equations (|3.15[) and (|3.16|) are 
a set of very simple equations that determine the resolvent elements of undirected 
regular Husimi graphs. It is one of the main results of our previous work [32 . 
From the expression of G s we find straightforwardly the Green function 

and the spectrum, according to eq. p.7[) and p,17p . 

c ImG, 



(3.18) 



p{\) = 



7r(A-cReG s ) 2 + c 2 (ImG s 



3.4. Spectra of regular undirected graphs. We solve the algebraic equa- 
tions (|3.15[) - (|3.16[) to find the spectrum of (£, c) -regular undirected Husimi graphs. 
Due to their simple linear structure, these recurrence relations can be solved ex- 
cactly and allow to obtain the analytical form of the polynomials in the variable 
G s for any value of £ > 2: 

• £ = 3 corresponds with a quadratic equation: 
G s [z-(c- l)G a ] - G s = 2. 
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4 gives a cubic equation: 

2[z-(c-l)G a ] 



Gs [z-(c-l)G s r -2 
5 is determined by a quintic equation: 

2[z-(c-l)G s ] 3 -4[z-(c-l)G s ] 



G. = 



[z-(c-l)G s ] 4 -3[z-(c-l)G B f 
m £ = 6 follows from a quartic equation: 

q 2[z-(c-l)G s ] 2 -4 



1)G S ] 3 -3[z-(c-l)G s }' 



• For £ > 6, the polynomials have a degree larger than four. 

The root of these polynomial equations which gives the expression for the spectrum 
is a stable hxed point of eq. (I3.14[) . In general, one hnds the roots of polynomials in 
terms of radicals up to degree four. For larger degrees, algebraic solutions in terms 
of radicals no longer exist, apart from some particular situations [45] . The roots 
of general polynomials with degree larger than four are given in terms of elliptic 
functions |45j . 

We have solved the above equations for I = 3, 4, 6 and have found the analytical 
expression for pi(\), generalizing the Kesten-McKay law |33L 146] to regular graphs 
with cycles. For other values of £, eqs. (|3.15l) - (|3.16l) are solved numerically in a 
straightforward way, allowing to study the spectrum as a function of £ with high 
accuracy. 

From the solution of the resolvent equations, we have found the expressions for 
the spectra pi{\) of {I , c)-regular undirected Husimi graphs. We point out that for 
£ = 2 we recover a sparse regular graph without short cycles. In this case we have 
the Kesten-Mckay eigenvalue-density distribution 



(3.19) (02(A) = 



2tt c 2 - A 2 



for A G [— 2\J c — 1, Isjc — 1], and P2(A) = otherwise. The expression (|3.19[) follows 
from solving eq. (|3.14j) . 

For £ = 3 we recover the spectra /33(A) of triangular Husimi graphs 47 



2(c-l) y/DsW , 1 

3 ( 



/03(A) = v ow + _s c2 S(X;-2) 1 

™ £ 3 (A)+ A^ + (l-A) 



for D 3 (X) = 8(c - 1) - (A - l) 2 > 0, and p 3 (A) = otherwise. Therefore, the 
support of p 3 (A) is A € [1 - 2^2(c- 1), 1 + 2y/2(c-l)]. 

For £ = 4 we find the spectrum of a square Husimi graph 

m 6y/3c( C -l) g _(A) 

MA) = — 71 



2(c-3)A + cg + (A) +3 7rc 2 g 2 (A), 
for I?4(A) > and /34(A) = otherwise, where 

g±(A) = 4 /3 ± s - 3 ' S ±( A ) = 9A ( C + !) - A ' 3 ± 9 V / £>4(A), 
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and 



9 X 2 

"•«~5*-T 



- 22c 



13) + ^(c-2) 3 . 



The edges of /34(A) are determined by finding the roots of .04(A) = 0. For c — > 00, 
/54(A) converges to the Wigner semicircle law. For c = 2, the spectrum contains a 
power-law divergence /04(A) ~ |A| -1 / 3 as |A| — > 0. 

We have also found the analytical expression for I = 6: 

4 Cx /i?(A)F(A) 



Pe(A) 



7Ti?(A) 



(c-4) 

(5=1) 



|A|+2aR(A) +ttc 2 F(A) 



for I?6(A) > and Pq(\) = otherwise, with 
Wfl(A) = 

i?(A) = 

F(A) = - 
and 

£> 6 (A) 
3(A) (c-1) 4 

r(A) (c-1) 5 




ur(A) 



! (A), 



<f(A) 

-9A 2 +48(c-l)-(2c-5) 2 



(4c - 7) 2 - (4c - 7) (2c - 5) (2c - 5) 2 (34 - 16c) 



+ 



2(c-l) 
16(2c-5) (2c- 



3(c-l) 



5) s 



3 27(c-l) 

The function Z?g(A) is the discriminant of the cubic polynomial associated to the 
quartic polynomial for G s . The edges of pe{\) are obtained from the roots of 
Dq(X) = 0. The spectrum converges to the Wigner semicircle law when c — > 00. 

For t = 5 and i > 7 we obtain the spectrum by solving numerically the set 
of eqs. (|3.15p - (13.16p . One can show that pi (A) converges to the Wigner law in the 
limit c — > 00, and converges to the Kesten-Mckay law in the limit I — > 00 (this limit 
corresponds to a graph without short cycles). 

In figure 2] we present the evolution of the spectrum as a function of the con- 
nectivity c for the case I = 4. We notice indeed the fast convergence to the Wigner 
semi-circle law for c — > 00. In figure [5] we present the evolution of the spectrum as a 
function of the cycle length £, for fixed c = 2. We see how the spectrum converges 
rapidly to the Kesten-McKay law for I — > 00. 

4. Spectral analysis of directed graphs with cycles 

In our study of spectral properties of regular directed graphs with cycles we 
follow again four steps. First, we write the spectrum in statistical mechanics terms 
[14j . This is done by mapping the resolvent calculation of a directed graph on a 
resolvent calculation of a related undirected graph, using the Hcrmitization pro- 
cedure [48j . The resolvent of this undirected graph is then analyzed using the 
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Figure 4. Spectra of (4, c)-rcgular undirected Husimi graphs of 



connectivity c = 2,3,4 and with a scaling Ai 



The spectrum converges to the Wigner semi-circle law for c — > oo. 



— ell = 3 
■ ■ ■ ell = 5 
-- ell = 7 
■-■ ell = 11 

— Kesten-McKay (c=4) 




Figure 5. Spectra of (£, 2) regular undirected Husimi graphs with 
a scaling -> Aij/y/2c — 1 and with cycle lengths £ = 3, 5, 7, 11. 
The spectrum converges to the Kesten-McKay law for £ — > oo. 



methodology presented in section 3. Thereby, the infinite-dimensional nature of 
the resultant graphs again allows to derive a closed expression in submatrices of 
the resolvent matrix. Thirdly, we show how this closed set of equations determines 
the spectrum of directed regular Husimi graphs and we derive their explicit form in 
this case. Finally, the resultant algebraic expressions are solved to arrive at explicit 
analytical expressions in the support of the spectra. 

4.1. Statistical mechanics formulation of the spectrum. The eigenval- 
ues Ai, . . . , Ajv of the N x N adjacency matrix A of directed Husimi graphs are dis- 
tributed in the complex plane, contrary to the real eigenvalues for undirected Husimi 
graphs. By introducing 9* = |^^|+iJ0 and using the relation d*(x + iy)^ 1 = 
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nS(x)S(y), the density of states p(X) = N 1 Y2u=i S(x ~KeX f _ l )S(y — ImXfj) at a cer- 
tain point X = x + iy can be written formally as p(A) = lirn/v-->oo(-A^7r) _1 <9*TrG'(A), 
where G(X) is the resolvent G(X) = (A — A) -1 . The operation (•)* denotes complex 
conjugation. The N x N resolvent G(X) is the central object of interest and its 
non-analytic behavior at the eigenvalues of A poses difficulties in applying various 
techniques well-developed for Hermitian matrices |48j . An elegant way to avoid 
this problem is the Hermitization method. We define a 2N x 2N block matrix 

eI N -i(X-A) 
-i(X*-A T ) eI N 

where e > is a regularizer and In is the TV-dimensional identity matrix. The 
lower- left block of lim c _ > o+ H~ 1 (X) is precisely the matrix G(A). Thus, the problem 
reduces to calculating the diagonal matrix elements Qj (A. e) = [i? ( T 1 (A)] - +N (j = 
1, . . . , N), from which the spectrum is determined according to 



(4.1) 



H t (X) = 



(4.2) 



lim 

+0+, TV- 



TV 



d*Gj(X,e). 



The form of the enlarged matrix H depends on the problem at hand and 
different proposals have appeared in the literature [48, [491 150U51] . The form (14. ip 
is particularly convenient here, since its Hermitian part is a positive-definite matrix 
and one can represent if -1 as a Gaussian integral. For this purpose we introduce 

a set of two-dimensional column vectors n with complex elements and 

the "Hamiltonian" function 



(4.3) 

where 
(4.4) 



«({*,-, #J}; A) = V* 



i-Se(X)$i 



N 





A. A A 



A, 



and S e (X) = [el 2 — i (xa x — ycr y )], with (cr x , a y ) denoting Pauli matrices. 

A graphical representation using an induced graph is again useful in these 
calculations. For a non-Hcrmitian matrix with real entries the induced graph is 
directed, contrary to an undirected graph for real symmetric matrices. Graphically 
the matrix elements correspond then with a directed edge from node i to node j. 

Combining the representation of [Jf ~ x (A)l . . as a Gaussian integral with eq. (|4.3I) . 
Gk(X,e) reads 



(4.5) Q k {X,e) 



N 



where we have introduced the complex-valued measure Ylj=i ^({^i: tyd&jd&j 
(4.6) P^^JjjA) 



exp 


'-■«({*< 


*!};A)^ 




/ 


nf =1 d^d*] 


exp 


-«({#i,#t};A)" 



Equation (|4.5|) shows that the local marginals {V(^?k,^l', X)}k=i,...,N determine 
the functions {Gk}k—i,...,N, from which the spectrum follows through eq. (|4.2|) . 
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4.2. The resolvent equations. We use again the infinite dimensional nature 
of Husimi graphs to derive an exact equation in the resolvent elements. Due to 
the sparse structure of A, the average number of nodes in a path connecting two 
randomly chosen cycles scales as IniV (see figure [8]). This fundamental property 
allows to compute {V(^ki & k )}k=i,...,N using the cavity method, as demonstrated 
in appendix A. 2. The main difference with the undirected case resides in the "state 
variables" describing the nodes of the graph and the corresponding "Hamiltonian" . 
While in the undirected case they are scalar real variables, here there is a two- 
dimensional complex- vector 3?^ associated to each vertex and they mutually interact 
through JJij, see eq. (|4.3j) . Hence the resolvent equations involve two-dimensional 
matrices. 

Extending the cavity formulation [14] to directed graphs with cycles, see ap- 
pendix A. 2, we have derived the following equation 



(4-7) Qi{\e) 



S e {\)+ V A£l>« 



V 



21 

where d\ l ~^ is the set of all (£ — 1) tuples {jx,ji, ■ ■ ■ which form a cycle of 

length £ with node i. The 2 x 2(£ - 1) block matrix Af a = (J ih ... 
encodes the interaction between i and a given tuplet a — (ji, J2, ■ ■ ■ ,je-i)- The 
matrix is a two-dimensional matrix filled with zeros. The 2(£ — 1) x 2(£ — 1) block 
matrices T>a = Z-v ■ ■ fulfill the cavity equations 

Ui ,J2,--- ,Je-i) J M 

(4.8) 2?W = (s e (X) <8 Ii-x + B« + ih a + ^L^) ^ , 

where i = 1, . . . ,N and a € 9. . The matrix L Q is composed of 2 x 2 block 

elements defined by [h a ] nrn = [L( J1 j 2 ,.. J) _ 1 )]nm = S n ,m+i Jj n ,j m , where n = 

2, ... ,£ — 1. The matrix B a is a diagonal matrix formed by the following 2x2 
block elements 

(4-9) E ^ItPf^^ 

PedY~ 1 '\(i,j 1 ,...,jh-xdh+\,---,U-i) 

with fc = 1,... ,£- 1 and a = ■ ■ • ,^-i)- 

Once eqs. (|4. 8[) have been solved, the spectrum follows from eqs. (|4.7[) and 
(|4.2j) . The cavity equations have an interpretation in terms of a message-passing 
algorithm: the matrix X>„ is seen as the message sent by the (£ — 1) nodes of 



cycle a to node i of the same cycle |43l . This completes the general solution of the 
problem. 

4.3. The resolvent equations for regular directed graphs. We deter- 
mine now the resolvent equations for the spectrum pg of infinitely large {£, c)-regular 
directed Husimi graphs. These graphs have = c for i = 1,...,N, i.e., each 

vertex is incident to c cycles of length £. We set Aij — 1 and Aji = when there is 
a directed edge from node i to j, such that the corresponding matrix assumes 
the form J = \ {o x + ia- y ). As a consequence, the matrices {T>^ , A^, L^} become 
independent of the indices (i,/3). It is convenient to define the two-dimensional 
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matrix G A = A T VA, where A T = (J ... J T ). We write p(\) in terms of G A 
as follows 

(4.10) Pt [X) = — lim d* [S e (X) +CG4 1 . 

ITT e— >0 



From eqs. (|4.8[) and (|4.9j) one obtains that, for £ > 2, the two-dimensional matrix 
solves the equation 

(4.11) G A = A T \(S t (A) + (c - 1)G A ) L t - X + iJ T ® 

where is a (^ — l)-dimensional matrix with elements [2^_i],-j = <5ij+i- The 

derivative of eq. (I4.11[) yields an equation in 8*Ga, which has to be solved together 
with (j4~TTj) to find p e (X) through eq. ((4TTU1) . 

Equation (|4.1ip allows to derive accurate numerical results for the spectrum 
of directed Husimi graphs as a function of I. As an illustration, we present in 
figure [6] some cuts of P3(A) and /04(A) along the real direction for fixed values of 
y. These results correspond very well with direct diagonalization, confirming the 
exactness of (j4.11j) . For a three-dimensional graph of /93(A) we refer the reader to 
Analogously to undirected Husimi graphs, pe(X) converges to the spectrum of 




FIGURE 6. Three cuts of the spectrum pi(\) of (£, c) -regular di- 
rected Husimi graphs along the real direction for c = 2, I = 3 [32j 
and c = 2, £ = 4. These results (solid lines) are obtained from 
the numerical solution of eq. (|4.11l) and they are compared with 
direct diagonalization results (markers) for an ensemble of 3 x 10 4 
matrices of dimension N — 10 3 . 



a directed regular graph without short cycles for I — > 00 |20L 131), I52j : 
(4.12) Poo (A) 



1 / \ 2 

c — 1 



>-|A| 2 

for |A| 2 < c, and PooW — otherwise. This convergence is shown numerically in 
|32j . By rescaling Aij —> Aij /y/c— 1 , the solution of (|4.11j) leads to Girko's law in 
the limit c — > 00. 
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4.4. The spectral boundaries for regular directed graphs. In order to 
derive analytical equations for the support of pt(X), we determine the inverse of the 
2(£— 1) x 2(£ — 1) matrix present in eq. (|4.1ip . Since this matrix has a tridiagonal 
block structure its inverse can be computed analytically using the method in 1441 . 
Applying this scheme to the matrix in eq. (14.11 [) . we have simplified (|4.11|) into 
an equation involving sums and products of only two-dimensional matrices. This 
equation forms the equivalent for directed regular graphs of the equation (|3.15[) for 
undirected regular graphs. The resultant equations in Ga can be solved using the 
following ansatz 



(4.13) 



G A = 



a 

ib* 



ib 
d 



where b is complex and a and d are both real variables. The Hermitian part of this 
matrix is positive-definite provided that a and d are positive. This condition ensures 
that the Gaussian integrals in the cavity method are convergent |14j . Solving 
numerically eq. (|4.11j) for a finite regularizer e > 0, we find that a > and d > 0. 
In the limit e — > + , a and d vanish at the boundary of p(A). Therefore, setting 
e4 + and a — d — in eq. (|4.11[) . and solving the resulting equations for b leads 
to an analytical expression for the support of pi(X). In this way we obtain the 
following equations for b and A at the boundaries of the support: 

• £ = 3: 



(4.14) 
(4.15) 



b = 
|A - 



[A* - (c- 1)6*] 2 
|A-(c-l)6| 4 ' 
( C -1)6| 4 = ( C -1) [l + |A-(c-l)6| 2 



(4.16) 
(4.17) 



• l = A: 

b = 



[A* - (c - l)b*} 



|A-(c-l)6|« ' 

|A -(c - 1)6| 6 = (c - 1) [1 + |A - (c - 1)6| 2 + |A - (c - 1)6| 4 ] . 

The solutions of the polynomials (14. 15|) and (|4.17[) in the variable s = | A — (c - 
are given by 



1)6| 



(4.18) 



3: 



4: 




(4.19) s = 

where we have defined 

R±(c) 



[R + (c)] 



[ii_( C )]* + -(c- 



1) 



1 

27 l 



( c -iy + -(c-iy \-±f( c ) ) + -(c-i) 



81 v 



F(c) = 

with k = 1 + / c _-n ■ By parametrizing A — (c — 1)6 = s exp (it), with t £ [0, 2ir], and 
substituting this form in eqs. (|4.14l) and (14.161) . we find the following expressions for 
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the boundary of the support A^ (t) of triangular (£ = 3) and square (£ — 4) regular 
directed Husimi graphs: 

• £ = 3: 

(c-1) 

(4.20) A 3 (t) = s exp (it) + - — ^ exp (Sit) , 

• £ = i: 

(c-1) 

(4.21) A 4 (t) = s exp (it) + v ^ ' exp (Sit) . 

These are the parametric equations which describe, for each corresponding £, an 
hypotrochoid in the complex plane. The parameter s as a function of the cycle 
degree c for I = 3 and I — 4 is given by, respectively, eqs. (|4.18[) and (|4.19[) . 

A hypotrochoid is a cyclic function in the complex plane which is drawn by 
rotating a small circle of radius r in a larger circle of radius R |53j . The support 
of triangular and square Husimi graphs is therefore given by hypotrochoids with, 
respectively, R/r — 3 and R/r = 4. These analytical results for the support of 
the spectra of directed Husimi graphs for £ = 3 and £ = 4 are shown in the lower 
graphs of figure [7] The agreement with direct diagonalization results for c = 2 is 
excellent, confirming the exactness of our analytical results. Based on the form of 
eqs. (|4.14M.17j) . we conjecture that, for a given £ and c, the following equations are 
fulfilled at the boundary of the support of pe(X) 



(4.22) b = I*' -(«-!)*• 



-l 



s 2(t-l) ' 

1-2 

(4.23) s 2 ^- 1 ) = (c-l)^s 2 ". 

n=0 

Substituting A — (c — 1)6 = sexp (if) (f e [0, 2tt]) in eq. (|4.22[) reads 

fc- 1) 

(4.24) XAt) = s exp (if) + y „ ' exp [-i(£ - l)f] 

for the boundary of the support of a (£, c) directed regular Husimi graph. Re- 
markably, eq. (|4.24p is a hypotrochoid with a fraction R/r = £. The parameter 
s is determined from the roots of a polynomial of degree £ in the variable s 2 , see 
eq. (|4.23|) . Equation (14.23[) can also be written as 

(4.25) s* = c-^. 

We have found an analytical expression for the roots for £ = 3 and £ = 4. For 
larger values of £, we have solved eq. (|4.25[) numerically and, by choosing the stable 
solution, we have derived accurate values for the parameters of the hypotrochoids. 
We present explicit results for £ = 5 and £ = 6 in the upper graphs of figure 
[7] Direct diagonalization results exhibit once more an excellent agreement with 
the theoretical results, strongly supporting our conjecture that the support of the 
spectrum of directed regular Husimi graphs for general £ is given by eqs. (|4.24t - 
I4.25| . The support of regular Husimi graphs converges to the circle |A| 2 = c in the 
limit I — y oo, corresponding with the expression (|4.12[) for a graph without short 
cycles. 




Figure 7. Analytical solutions for the boundary of the support of 
directed (£, c)-regular Husimi graphs for several values of the cycle 
length I and the following values c of the number of cycles incident 
to each vertex: c = 2 (solid line), c = 3 (dashed line), c = 4 
(dotted line) and c = 5 (dot-dashed line). The hypotrochoids have 
a rotational symmetry by the angle 2ir/£, from which one obtains 
the value of the cycle length £. Direct diagonalization results (dots) 
for N x N matrices with N = 1000 and c = 2 arc shown. 



5. Conclusion 

In this work we have obtained the spectra of (un)directed Husimi graphs. The 
main result is a set of exact equations which determines a belief-propagation like 
algorithm in the resolvent elements of the matrix. For irregular graphs we have 
shown a very good correspondence between direct diagonalization results and our 
approach. For regular graphs we have derived several novel analytical expressions 
for the spectrum of undirected Husimi graphs and the boundaries of the spectrum 
of directed Husimi graphs. Remarkably, the boundaries of directed regular Husimi 
graphs consist of hypotrochoid functions in the complex plane. 

Our results indicate that, at high connectivities, the spectrum of undirected 
random graphs converges to the Wigner semicircle law, while the spectrum of di- 
rected random graphs converges to Girko's circular law. This convergence seems 
to be rather universal and independent of the specific graph topology. It would 
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be interesting to better understand the conditions under which finitely connected 
graphs converge to these limiting laws |21|, \24[ \54\ 155] . 

Finally, we point out that the eigenvalues of random unistochastic matrices 
are distributed over hypocycloids in the complex plane [56] . This close similarity 
with our results suggests an interesting connection between the spectra of I x I 
unistochastic matrices and regular directed Husimi graphs with cycles of length £. 
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Appendix A. Cavity method applied to random matrices 

We present the essential steps to determine the resolvent equations using the 
cavity method [371 157j . This method is based on the introduction of cavities in a 
graph Q forming subgraphs , where the node i and all of its incident edges have 
been removed, see figure [5] In analogy one can also remove the i-th column and 
the i-th row from a matrix A to obtain the submatrix A^' . 



A.l. Resolvent equations for locally tree-like graphs. The cavity method 
is based on the consideration that a probability distribution P(x; z) defined on a 
locally tree-like graph has the factorization property: 

(A.i) p^{x dj]Z )= n^W). 

The quantity P^ is the i-th marginal of P^(x;z) on the cavity subgraph 
of g, and Pj?) is the marginal of P^(x; z) with respect to the set of variables dj. 
In the language of spin models, the factorization property follows from the locally 
tree- like structure of a typical neighbourhood in the graph, see figure [8] 

Following the derivation as presented in |13j , we find a set of closed equations 
in the marginals P- ' 



(A.2) P i (i) (a: 4 ;z)~ex P (-i^ 



2 

z x 



/ II dx k P k l) ( X k',z) exp IXi ^ A ikXk , 

\kedi\j J \ kedi\j J 



from which the marginals Pi follow: 



(A.3) P i (x i ;z)~exp[-i-£- 



exp ix, ^ A ikX k 

\kedi / \ feed, / 
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\ logN / 



Figure 8. Left: a graph with a locally tree-like structure. Intro- 
ducing a cavity at the vertex i decouples neighbouring vertices (in 
the sense that their mutual distance scales with log(iV)). Right: 
a Husimi graph. After introducing a cavity at the vertex i neigh- 
bouring pair of nodes become decouple. 



Finally, we use the fact that the P^ are Gaussian functions 

(A ' 4) ^^J^ri-'^)- 

to recover the resolvent equations (13.81) . after substitution of (IA.4I) in (IA.2I) and 
(|A3|) . 



A. 2. Resolvent equations for Husimi graphs. We apply now a similar 
logic to graphs with many cycles which have an infinite-dimensional structure. In 
this case we use the factorization property 

(A.5) P$-»(x a v-»;*)= II p ^{x a ;z). 

on the marginals of the distribution P(x;z). The factorization property follows 
from the fact that the average distance between different branches connected to i 
is of the order In iV after removal of i, see figure [8J Note that Pa is the marginal 
of P(x; z) for a (£ — 1) tuple a = (jx, . . . , j^-i) forming a cycle with the i-th vertex. 

We have generalized the derivation for regular Husimi graphs presented in [32] 
to the case of arbitrary Husimi graphs. We find a set of closed equations in the 
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marginals P a . 
(A.6) 



P a l) (x a ; z) ~ exp ( -± J2 x )w +i J2 A j 



k=l 



k=l 



(a) .(a) X (o,)X (a) 
k J k+1 J k Jfc+1 



n 



f}£df-V\c 



n 



with the (I — l)-tuple a — , , ■ • • >ij"i) ■ The marginals Pi are given as a 

function of the marginals P a ^ : 

(A.7) 



> x l + i A .(a) . ar.(a) a; 



P, (a:*; z) ~ exp -i 



/ ]J dx a P a l) (x a ;z) Y[ exp (i A y c<o i^c 



We now use the Gaussian ansatz for the marginals (x a ; z) 



(A.S 



ex P I 



with the — 1) X — 1) submatrix of the resolvent of the cavity matrix 



Jl Jl Jl J2 



•Y(i) 



(A.9) 



^ .( Q ) .( Q ) ^ .( Q ) .( Q ) 

^2 Jl JQ, J2 



Jf-lJl Jt-\J1 



We also use a Gaussian ansatz of the type jA 



G %) A°>) \ 
Ji Je—i 

A<*) A") 

J2 J£— 1 



G 



Ac) I 

-\Jt-X ' 



4| for the marginal P,. Substitution 



of these ansatze in (|A.6p and (IA.7I) gives the resolvent equations (j3.9p and (|3.10p . 

We remark that the resolvent equations can also be derived using methods from 
random matrix theory , i.e. by recursively applying the Schur-complement formula 
pjl3T]. 
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